Provide ability to get model configs with a model id #1654
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Gabefire
changed the title
|
Quick question: What org do tests inside Labelbox-python sdk run against? Is it just the default stageing org or an SDK-specific one? I ask because for this method, I'm trying to test, and I don't think we are cleaning the model configs between other tests. It should be assert two for the valid model ID given, but it has 297 model configs attached. Tests work against my prod org. basically, I attached some model configs and then tested if it returns two model configs. If you don't mind could I make the model id fixture delete all the model configs attached to a model when it tears down? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
I noticed there is no way to get model config ids from the UI or easily from SDK without attaching it to a project. So I made a method to get model configs for Live model evaluation projects based on a model id you can get from the UI.
This allows the flexibility to quickly add them to projects or just manage them in general, which is not even available on the UI yet.
Loom to explain issue:
https://www.loom.com/share/d086b0f8b4e5456c97a5077cf395f1b3?sid=e0ac0a7a-a48f-42fa-9725-0ef268a65d5f
Type of change
Please delete options that are not relevant.
All Submissions
New Feature Submissions